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Abstract. We present a convergence result for infinite products of stochastic ma- 
trices with positive diagonals. We regard infinity of the product to the left. Such 
a product converges partly to a fixed matrix if the minimal positive entry of each 
matrix does not converge too fast to zero and if either zero-entries are symmetric 
in each matrix or the length of subproducts which reach the maximal achievable 
connectivity is bounded. 

Variations of this result have been achieved independently in [T], [2] and [3]. We 
present briefly the opinion dynamics context, discuss the relations to infinite prod- 
ucts where infinity is to the right (inhomogeneous Markov processes) and present a 
small improvement and sketch another. 



1 Introduction 

Consider n persons that discuss an issue which can be represented as a real 
number. Assume further that the persons revise their opinions if they hear the 
opinions of others. Each person finds his new opinion as a weighted arithmetic 
mean of the opinions of others. This model of opinion dynamics has been 
analyzed for the possibilities of consensus by DeGroot g]. If these 

weights 

change over time we have an inhomogeneous consensus process. 

While the homogeneous process has strong similarities with a homogeneous 
Markov chain, things get different when inhomogcneity comes in. While a 
consensus process relies on row-stochastic matrices multiplied from the left, 
a Markov process relies on row-stochastic matrices multiplied from the right. 
And infinity to the right is unfortunately not the same as infinity to the left 
if we consider row-stochastic matrices. But nevertheless, both processes fit in 
the common framework of infinite products of row-stochastic matrices. 

Consensus processes are only briefly touched in the context of Markov 
chains 5 [. Besides the early approaches of opinion dynamics [4j[6] some results 
have been made in the context of decentralized computation [7J. Recently 
there have been some independent works that study consensus processes and 
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the underlying matrix-products in the context of opinion dynamics [51 |H1 IIP) , 
multiagent systems where agents try to coordinate [2] and flocking where birds 
try to find agreement about their headings [5]. 

In this paper we want to analyze the structure that positive diagonals 
deliver in inhomogeneous consensus and Markov processes. 

2 Consensus and Markov processes 

For n G N we define n := {1, . . . , n}. 

Let j4(0),^4(1), ... be a sequence of row-stochastic matrices. Unless oth- 
erwise stated we regard every matrix to be square and to have dimension 
n. 

For natural numbers s < t we define a forward accumulation A(s,t) — 
A(s) . . . A{t — I) and a backward accumulation A(t, s) — A{t — I) . . . A(s). 
Thus A(s, s + 1 ) = A(s + 1, s) = A(s) and A(s, s) is the identity. 

We briefly explain the two paradigmatic example processes where forward 
and backward accumulations play a role. 

Let p(0) be a stochastic row vector and Pi(0) is the zth component of p(0), 
which is equal to the proportion of probability mass or population which is 
in state i at the beginning. The sequence of row vectors p(t) := p(0)A(0, t) is 
thus an inhomogeneous Markov process and A(t)u t j] determines the transition 
from state i to j at time step t. In that context A(t) is called transition matrix. 

Let x(0) be a real column vector of opinions and 2^(0) stands for the 
initial opinion of person i. The sequence of vectors x(t) = A(t, 0)a;(0) is an 
inhomogeneous consensus process and A(t)uj] stands for the weight person i 
gives to the opinion of agent j at time step t. In that context A(t) is called 
confidence matrix. 

To understand the convergence behavior of inhomogeneous Markov and 
consensus processes the infinite products ^4(0, oo) and A(oo, 0) are of interest. 

In this paper we focus on transitions and confidence matrices with positive 
diagonals. Thus, we regard Markov processes where we have always a positive 
probability to stay in one state and consensus processes where persons have 
at least a little bit of self-confidence. 

In the next section we will see that the positive diagonal together with the 
Gantmacher form of nonnegative matrices will give us a good overview on the 
zero and positivity structure of the processes. 

In section [4] we go on with a convergence theorem that is built on this 
structure and conclude in section [5] with a small improvement and discussion 
on how to fulfill the conditions of the theorem. 

3 The positive diagonal 

We regard two nonnegative matrices A, B to be of the same type A ~ B if 
aij > <^> bij > 0. Thus, if their zero-patterns are equal. 
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Let A be a nonnegative matrix with a positive diagonal. For indices i,j G n 
we say that there is a path i — * j if there is a sequence of indices i = ii, . . . , i& = 
j such that for all / £ fc — 1 it holds a,i lt i l+1 > 0. We say i,j£n communicate 
if i — » j and j i, thus i «-> j. In our case with positive diagonals there is 
always a path from an index to itself, which we call self- communicating and 
thus ' is an equivalence relation. An index i £ n is called essential if for 
every j £ n with i — > j it holds j — > i. An index is called inessential if it is 
not essential. 

Obviously, n divides into disjoint self-communicating equivalence classes of 
indices 1%, . . . ,T p . Thus, in one class all indices communicate and do not com- 
municate with other indices. The terms essential and inessential thus extend 
naturally to classes. 

If we renumber indices with first counting the essential classes and second 
the inessential classes with a class I before a class J if J — > X then we can 
bring every row-stochastic matrix A to the Gantmacher form [11] 

" Ai 0" 

A 9 fy, 

A g+M . . . Ag +lt g Ag + 1 

Ap^l ■ ■ ■ Ap_g Ap_g +1 . . . Ap_ 

by simultaneous row and column permutations. The diagonal Gantmacher 
blocks A\,...,Ap in |l| are square and irreducible. Irreducibility induces 
primitivity in the positive diagonal case. For the nondiagonal Gantmacher 
blocks Akj with fc = g + 1, . . . ,p and / = 1, . . . ,fc — 1 it holds that for every 
fc e {g + 1, . . . ,p} at least one block of Ak,i, ■ ■ . , Ak : k-i contains at least one 
positive entry. 

The following proposition shows that an infinite backward or forward ac- 
cumulation of nonnegative matrices can be divided after a certain time step 
into subaccumulations with a common Gantmacher form. 

Proposition 1. Let (A(t)) te ^ be a sequence of nonnegative matrices with 
positive diagonals. Then for the backward accumulation there exists a sequence 
of natural numbers < to < <i < ■ • • such that for all i 6 No it holds 

A{t i+1 ,U) ~ A(ti,t ). (2) 

Thus, A(t i+ i,ti) can be brought to the same Gantmacher form for all i 6 n. 
Further on, all Gantmacher diagonal blocks are positive and all nondiagonal 
Gantmacher- Blocks are either positive or zero. 

The same holds for another sequences < sq < si < . . . for the forward 
accumulation and A(si, Si+i). 
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Proof. (In sketch, for more details see [T].) 

The proof works with a double monotonic argument on the positivity of 
entries: While more and more (or exactly the same) positive entries appear in 
A(t, 0) monotonously increasing with rising t, we reach a maximum at tg. We 
cut A{t^, 0) of and find t\ when A(t, t$) reaches maximal positivity again with 
rising t. We go on like this and get the sequence (A(t* +1 ,t*))i^ . Obviously, 
less and less (or exactly the same) positive entries appear monotonously de- 
creasing with rising i and we reach a minimum at k. We relabel tj :— t* k+ - 
and thus have the desired sequence (^)igN with A(tj+ ].,£») having the same 
zero-pattern. 

Positivity of Gantmacher blocks follows for all blocks A(U+i, tfW zi where 
we have a path J —* X. If we have such a path, then there is a path from each 
index in J to each index in X and thus every entry must be positive in a long 
enough accumulation. Thus, the block has to be positive already, otherwise 
(ti)ieNo is chosen wrong. 

To prove the result for forward accumulations, we can use the same argu- 
ments. □ 

The next section regards the convergence behavior of the Gantmacher 
diagonal blocks. 

4 Convergence 

A row-stochastic matrix K which has rank 1 and thus equal rows is called a 
consensus matrix because for a real vector x it holds that Kx is a vector with 
equal entries and thus represents consensus among persons in a consensus 
process. Suppose that A(t) := K is a consensus matrix. It is easy to see that 
for all u > t it holds for the backward accumulation that A(u, 0) = K while 
for the forward accumulation it only holds that A(0, u) is a consensus matrix 
but may change with u. 

We define the coefficient of ergodicity of a row-stochastic matrix A accord- 
ing to Hartfiel [5] as 



The coefficient of ergodicity of a row-stochastic matrix can only be zero, 
if all rows are equal, thus if it is a consensus matrix. 

The coefficient of ergodicity is submultiplicative (see [5]) for row-stochastic 
matrices A , . . . ,Ai 



n 




t{A, ■ ■ ■ A-lAq) < T{Ai) ■ ■ ■ r(Ai)r(A)). 



(3) 



If limt_ ) . 00 T(A(0,t)) — we say that A(0,t) is weakly ergodic. Weakly 
ergodic means that the A(0, t) gets closer and closer to the set of consensus 
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matrices and thus the Markov process gets totally independent of the initial 
distribution p(Q). 

For M C M>o we dehne min + M as the smallest positive element of M. 
For a stochastic matrix A we define min + A :— min^ gn ciy. We call min + the 
positive minimum. 

For the positive minimum of a set of row-stochastic matrices Aq, . . . , Ai it 
holds 

min + (Ai •••Aq) > min + Ai ■ ■ -min+Ao. (4) 

Theorem 1. Let (A(t)) te jq be a sequence of row- stochastic matrices with pos- 
itive diagonals, < t a < t\ < . . . be the sequence of time steps defined by 
proposition [IJ Zi, . . . , I g be the essential and J be the union of all inessential 
classes of A(ti,to). 

If for all i g No it holds min + A(ti + i, ti) > Si and $i ~ °°; then 





~Ki 


0" 




lim A(t, 0) = 






A(t o ,0) 


t—>oo 


K g 







not converging 


Q_ 





where K\, . . . , K g are consensus matrices. (The matrices have to be sorted by 
simultaneous row and column permutations according to 2i, . . . ,2 g , J .) 

Proof. The interesting blocks are the diagonal blocks. It is easy to see due 
to the lower block triangular Gantmacher form of A(t i+ i,ti) for all i £ No, 
that all diagonal blocks only interfere with themselves when matrices are 
multiplied. 

Let us regard the essential class Ik and abbreviate Ai :— A(tj+i, £i)[x h( Xj,]- 
We show that the minimal entry in a column j of a row-stochastic matrix 

B cannot sink when multiplied from the right with another row-stochastic 

matrix A, 

n 

min(AB)ij =min> aikbkj >min6jj. 

~ ~ fe=l 

[ : ; the minimum of entries in column j of the product Ai---Ao is 
monotonously increasing with rising i 6 No. With similar arguments it fol- 
lows that the maximum of entries in column j of the product Ai ■ ■ ■ Aq is 
monotonously decreasing with rising i £ No- 

Further on, it holds due to ([3]) and the definition of the coefficient of 
ergodicity that 

oo oc oc 

lim T(A t . . . A\Aq) < TT r(Ai) = TT(1 - St) < TT e - * = *~ EEl S * = °- 

i—1 i—1 i—1 

The maximal distance of rows shrinks to zero. Both arguments together imply 
that Unx^oo (A^ . . . A\Aq) is a consensus matrix which we call K^. 
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Now it remains to show that the [J, J^-diagonal block of the inessential 
classes converges to zero. 

Let us define ||-|| as the row-sum-norm for matrices. It holds ||^4[j" ! j'](^i+i, ^:)|| 
(1 — Si) and thus like above it holds 

oo oo 

IMW](°°>*o)ll ^ II *<)l I < Hi 1 - *0 ^= °- 

1=1 i=l 

This proves that lim^oo A[jj](t, 0) = 0. □ 

An inhomogeneous consensus process A(t, 0)a;(0) with persons who have 
some self-confidence stabilizes (under weak conditions) such that we have g 
consensual subgroups (the essential classes) which have internal consensus, 
while all other persons (the inessential indices) may hop still around build- 
ing opinions as convex combinations of the values reached in the consensual 
groups. 

We will not treat the Markov case in detail. But a similar result can be 
made, but not with fixed matrices Ki, . . . , K g but with weak ergodicity after 
the time step so within the independent subgroups I\, . . . ,T g . 

In an inhomogeneous Markov process p(0)A(0,t) a certain number of in- 
dependent absorbing classes evolve which get independent of their initial con- 
ditions after a certain time step. 



5 Discussion on conditions for min + A(t i+1 , ti) > Si 

One thing where theorem Q] stays unspecific is that it demands lower bounds 
for the positive minimum of the accumulations A(f j+i, ti). But, what proper- 
ties of the single matrices may ensure the assumption min + A(ti+i, ti) > Si 
with Si = oo? 

The first idea would be to assume a uniform lower bound for the positive 
minimum S < min + A(t) for all t. But this is not enough. 

Recent independent research [31 [TO] has shown that either bounded in- 
tercommunication intervals (i,+i — U < N for all i 6 No) or type- symmetry 
(A ~ A T ) of all matrices A{t) can be assumed additional to the uniform lower 
bound for the positive minimum to ensure the assumptions of theorem [TJ But 
improvements are possible. 

Bounded intercommunication intervals Let us regard S < min + A(t) for all 
t e N . If t i+1 - U < N it holds by (0J) that min + A(t i+1 ,ti) > 5 N and thus 
Si=o ^ N = 00 an d thus theorem [T] holds. But tj+i — 1% may slightly rise as the 
next two propositions show. 

Proposition 2. Let < 5 < 1 and a £ R>o then 

oo 

g S alo S (n) <OQ ^ => S<e- 1 . (5) 



Products of stochastic matrices with positive diagonals 



7 



Proof. We can use the integral test for the series Y^Li <5 alog ^"* ) because 
f(x) := S al ° si - X ' is positive and monotonously decreasing on [1, oof. 
With substitution y = log(x) (thus dx = e v dy) it holds 

i />oo />oo 

S aloB( - x) dx = I e Qlog(5)log(;r) dT = J e alog - {8)v e y dy 

e ay(lo g (S) + l) dy 



The integral is finite if and only if log(J) + 1 < and thus if 5 < e 1 . 
Proposition 3. Let < 5 < 1 and a e R >0 then 



oo 

E 

n — 3 



5 alog(log(n)) = ^ (g) 



Proof. We can use the integral test for the series Y^Li <5 alog ( log(n '" ) because 
f(x) :— 8 a lo s( lo s( x )) j g p OS itive and monotonously decreasing on [3, oo[. 
With substitution y = log(log(a;)) (thus dx = e^ v+e ^dy) it holds 



DC 



galo S (\og{x))^ x _ J g alog((5) log(log(x)) ^ _ j g a log(8)y e y+e y ^ 
e ay(log(S) + l)+e« dy 



The integral diverges because ay(log(S) + 1) + e y — ► oo as y — > oo. □ 

Thus, assuming min + A(t) > S > for all t 6 No we can allow a slow 
growing of fj+i — U to fulfill the assumptions of theorem [TJ Acceptable is a 
growing as quick as log(log(i)). If U+\ — U grows as log(i) then it must hold 
5 > e" 1 > i. This can only hold if each row of A(t) contains only two positive 
entries (due to row-stochasticity) . 

Type- symmetry Another way to ensure the assumptions of theorem [1] is to 
demand all matrices to by type-symmetric and have a positive minimum uni- 
formly bounded form below by S. Perhaps a small improvement can be made 
with a very slowly sinking positive minimum approaching zero. But giving a 
precise form is a task for future work. 
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